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ABSTRACT 


The  criteria  employed  by  engineers  in  the  selection  of  various  tech- 
nical information  channels  in  problem- solving  endeavors  are  investigated. 
The  relationships  of  certain  criteria  identified  in  past  research  to  such 
factors  as  frequency  of  channel  utilization  and  the  rate  at  which  engi- 
neers accept  or  reject  technical  information  received  from  specific  chan- 
nels are  the  focal  points  of  the  study. 

A  direct  relationship  is  found  between  perceived  accessibility  of 
information  channels  and  several  objective  measures  of  utilization, 
whereas  no  definite  support  is  found  for  the  hypothesis  that  the  chan- 
nels perceived  highest  in  technical  quality  are  those  used  most  fre- 
quently.  On  the  other  hand,  perceived  technical  quality  shows  a  direct 
relation  to  message  acceptance  ratio. 
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Before  information  technologists  are  able  to  design  effective  systems  to 
provide  the  scientist  and  engineer  with  the  information  necessary  for  his  work, 
a  great  deal  must  he   learned  about  the  behavior  of  the  user  population.   Such 
research  is  requisite  both  to  assess  needs  and  to  improve  predictions  of  the 
impact  on  the  total  information  system  of  new  components  or  modifications  of 
existing  ones . 

As  a  result,  a  large  number  of  what  have  come  to  be  called  "user  studies" 
(investigations  of  the  information  seeking  behavior  of  scientists  and  engineers) 
have  been  performed  over  the  past  ten  years.   Such  studies  endeavor  to  d.eter- 
mine  (l)  the  effectiveness  of  currently  used  information  channels,  or  (2)  the 
criteria  governing  the  selection  of  information  channels.   Most  such  studies, 
until  very  recently,  have  not,  however,  differentiated  these  two  goals.   They 
have  implicitly  assumed  channel  effectiveness  to  be  the  single  criterion  gov- 
erning channel  selection.   Opierating  from  this  assumption,  it  \ras  necessary 
only  to  observe  the  users  and  to  assign  performance  measures  to  the  channels 
on  the  sole  basis  of  the  extent  to  vfhich  they  are  used. 

Allen  (1966b;  1966c),  applying  an  independent  measure  of  effective  chan- 
nel performance,  found  no  relation  whatever  between  this  measure  and  the  ex- 
tent to  which  each  of  eight  channels  were  used.   These  results  counter  any  as- 
sumption of  information  quality  as  the  single  criterion  upon  which  channel  se- 
lection is  based.  Allen  proceeds  to  demonstrate  the  by  now  obvious  fact  that 
there  exists  in  such  a  decision  process  a  second  parameter  of  considerable 
consequence.   In  addition  to  the  value  of  a  given  channel,  there  is  a  certain 
cost  associated  with  using  it.   The  present  study  is  directed  at  the  measure- 
ment of  relative  costs  associated  with  the  use  of  each  of  nine  information 
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channels  by  R&D  engineers  and  the  relative  weights  assigned  cost  and  value  in 
this  decision  process. 

Cost  in  this  sense  is  a  rather  complex  concept.   It  may  consist  of  many 
dimensions  --  economic,  psychological  and  physical.   This  study  measures  per- 
ceived cost  to  the  user  in  terms  of  channel  accessibility  and  ease  of  use. 
There  is  considerable  support  for  the  idea  of  measuring  cost  on  these  two  di- 
mensions.  First,  Allen's  (1966c)  data  led  him  to  hypothesize  that  the  fre- 
quency with  which  a  channel  is  used  is  principally  determined  by  the  accessi- 
bility of  the  channel  to  the  engineer  seeking  information  (Figure  l).   Second, 
both  V/erner  (1965)  and  Rosenberg  (1966)  conclude  that  the  behavior  of  the 
users  they  studied  appeared  to  be  influenced  by  perceptions  of  the  ease  with 
which  an  information  channel  might  be  used. 

Allen  (1966c)  goes  on  to  propose  that  the  perceived  technical  quality  of 
information  provided  by  an  information  channel  is  taken  into  account  through 
a  filtering  process  (Figure  l)  during  which  the  proportion  of  ideas  rejected 
is  greater  for  some  channels  than  for  others.   Tlie  present  study  goes  on  to 
test  this  hyi^othesis  by  comparing  the  rate  at  v/hich  ideas  are  accepted  or  re- 
jected for  each  of  seven  channels  v/ith  engineers'  perceptions  of  the  technical 
quality  and  reliability  of  the  information  delivered  by  each  of  the  channels . 

RESEARCH  METHODS 
The  study  was  conducted  in  two  divisions  of  a  large  electronics  firm.  A 
sample  of  33  engineers  was  initially  selected;  of  these  19  remained  fully  co- 
operative over  the  15-week  period  of  the  study.   Of  the  19  cooperating 


A  comparison  of  the  I9  cooperating  engineers  with  the  I'l-  non-cooperative  ones 
shows  no  reason  to  suspect  that  they  differ  in  terms  of  any  background  charac- 
teristics, or  (from  the  evidence  available)  in  terms  of  their  information 
gathering  behavior. 
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FIGURE  I.         CHANNEL   SELECTION   AND    FILTERING 

Note:   Reproduced  from  Allen  (1966c). 
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engineers,  eight  are  employed  in  one  division,  11  in  another.   Those  who  are 
employed  in  the  first  division  are  further  subdivided  into  those  who  work  in 
a  components  laboratory  and  those  who  are  with  a  systems  laboratory.   The  two 
laboratories  are  separated  by  about  one-half  mile;  the  second  division  is  l8 
miles  away.   The  mean  age  of  the  19  cooperating  engineers  is  33  years  and  the 
range  2k-   to  43  years.   Six  have  M.S.  degrees,  the  remainder  all  hold  B.S.  de- 
grees in  engineering.   They  have  been  with  their  present  company  an  average 
of  five  and  one-half  years. 

The  data  were  gathered  by  means  of  several  specially  designed  question- 
naires (Figures  2  and  3)^  combining  the  Solution  Development  Record  (Allen, 
1966a;  1966b)  with  a  series  of  rank  orderings  of  nine  information  channels 
(Tab]e  l)  on  the  basis  of  each  of  four  criteria: 

(1)  Accessibility  -  accessibility  of  the  nine  information 
channels  (v/ithout  giving  consideration  to  the  relia- 
bility or  quality  of  the  information  expected) . 

(2)  Ease  of  Use  -  ease  of  use  of  the  nine  information 
channels  listed. 

(3)  Technical  Quality  -  technical  quality  or  reliability 
of  the  information  obtainable  from  each  of  the  nine 
channels  listed  (without  giving  consideration  to  the 
accessibility  of  the  channel). 

{k)      Degree  of  Experience  -  degree  of  experience  the  engi- 
neer has  had  with  the  nine  channels  during  his  career . 

The  vise  of  the  Solution  Development  Record  itself  (Figure  2)  has  been  de- 
scribed in  detail  elsewhere  (Allen,  1966a;  1966b).  A  typical  plot  of  alterna- 
tive probabilities  over  time  is  shown  in  Figure  k.      Plots  like  this  were  used 
to  assist  in  interviewing  individual  engineers  at  completion  of  the  study.  Re- 
ferring to  the  plot,  the  interviewer  can  frame  specific  questions  about  the 
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Massachusetts  Institute  of  Technology 
Solution  Development  Record 

Name : Date : 

Problem:  

a.  estimate  of  probability  that  a  given 

alternatives  under  consideration  alternative  will  be  employed  (please 

circle  a  probability  estimate  for 
each  alternative) 

0  .1  .2  .3  .h     .5  .6  .7  -8  -9  l-O 

0  .1  .2  .3  A  .5  .6  .7  -8  .9  1-0 

0  .1  .2  .3  .k     .5  .6  .7  -8  .9  1-0 


0  .1  .2  .3  .k     .5  .6  .7  -8  .9  1.0 

(Circled  Probabilities  Should  Add  to  l.O) 

b.   If  technical  information  having  an  impact  upon  your  visualization  of  the 
problem  or  any  of  its  potential  solutions  were  received  at  any  time  during 
the  past  "i;eek^  please  circle  the  source(s)  of  that  information  on  the  line 
below . 

Information  Source(s):   L   V   C   ES   TS   CR   G   E   D 
Figure  2.  The  Solution  Development  Record 
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See  Table  I. 

information  channels  which  were  used  to  generate  or  reject  alternatives^  or 
that  cause  the  preference  accorded  the  alternatives  to  shift. 

The  channel  ranlcings  for  each  criterion  dimension  were  obtained  for  dif- 
ferent weeks  over  the  co-urse  of  the  study.  Any  confusion  over  the  meaning 
of  each  dimension  was  clarified  at  the  time  of  the  final  interview,  and  some 
re-rankings  were  made  at  that  time . 
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Using  the  definitions  of  the  information  channels  below  and  ignoring  all  con- 
siderations of  the  technical  information  expected  from  each  of  the  channels, 
please  rank  the  channels  listed  as  to  their  "accessibility"  (assign  a  "l"  to 
the  channel  you  find  most  accessible;  a  "2"  to  the  channel  you  find  next  most 
accessible:  etc.)- 

L       V       C       ES       TS       CR       G       E       D 


Figure  3a.   Portion  of  the  Channel  Ranking  Form  for  the  Criterion  of  Accessibility. 
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Using  the  definitions  of  the  information  channels  below,   please  rank  the  chan- 
nels listed  as  to  their  "ease  of  use" .   (Assign  a  "l"  to  the  channel  you  find 
"easiest  to  use";  a  "2"  to  the  channel  you  find  next  "easiest  to  use";  etc.) 

D    TS    ES    CR    V    L    C    G    E 

Figure  3b.   Portion  of  the  Channel  Ranlcing  Form  for  the  Criterion  of  Ease  of  Use. 

Assume  that  it  is  necessary  for  you  to  perform  an  information  search  for  the 
purpose  of  generating  a  new  alternative  approach  to  the  current  technical  prob- 
lem under  consideration  or  that  you  require  technical  information  to  expand  or 
elaborate  an  already  existing  approach  for  solution  of  your  technical  problem. 
Keeping  this  assumption  in  mind  and  using  the  definitions  of  the  information 
channels  below,  please  rank  the  channels  as  to  the  technical  quality  and  con- 
tent expected  from  each.   Ignore  all  considerations  of  ease  of  use  and  "ac- 
cessibility" as  they  might  relate  to  a  given  channel.   (Assign  a  "l"  to  the 
channel  you  find  highest  in  quality  and  content;  a  "2"  to  the  channel  having 
the  next  highest  technical  quality  and  content;  etc.) 

L       V       C       ES       TS       CR       G       E       D 


Figure  3c .  Portion  of  the  Channel  Ranking  Form  for  the  Criterion  of  Perceived 
Technical  Quality. 

The  purpose  of  this  questionnaire  is  to  ascertain  your  subjective  estimate  of  the 
amount  of  experience  you  have  had  with  the  information  channels  considered  in 
this  study.  You  are  not  asked  for  absolute  rankings  but  for  relative  rankings. 
The  definitions  of  the  various  information  channels  appear  below.   Keeping  these 
definitions  in  mind,  please  rank  the  information  channels  below  as  to  the  relative 
amount  of  experience  you  have  had  with  each  one.   (Assign  a  "l"  to  that  channel 
with  which  you  have  had  most  experience  during  yotir  engineering  career;  a  "2"  to 
that  channel  which  ranks  second  in  your  amount  of  experience;  etc.) 

TS       V       L       D       E       C       G       CR       ES 


Figure  3d.   Portion  of  the  Channel  Ranliing  Form  for  Degree  of  Experience. 


*See  Table  I. 


NOTE:   Each  of  the  Channel  Ranking  Records  shown  in  this  figure  was  originally  a 
separate  questionnaire  administered  at  a  different  point  in  time. 
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Table  I 
Information  Channels 


L  =  literature ; 


V  =  vendors; 


C  =  customer: 


ES  =  external  sources: 


TS  =  technical  staff: 


CR  =  company  research: 


G  =  group  discussion: 


E  =  experimentation: 


D  =  other  division: 


books,  professional,  technical  and  trade  jour- 
nals and  other  publicly  accessible  written  ma- 
terial. 

representatives  of,  or  documentation  generated 
by  suppliers  or  potential  suppliers  of  design 
components . 

representatives  of,  or  documentation  generated 
by  the  government  agency  for  which  the  project 
is  performed. 

sources  outside  the  laboratory  or  organization 
which  do  not  fall  into  any  of  the  above  three 
categories.  These  include  paid  and  unpaid  con- 
sultants and  representatives  of  government 
agencies  other  than  the  customer  agency. 

engineers  and  scientists  in  the  laboratory  who 
are  not  assigned  directly  to  the  project  under 
consideration. 

any  other  project  performed  previously  or  si- 
multaneously in  the  laboratory  or  organization 
regardless  of  its  source  of  funding.   This  in- 
cludes any  unpublished  documentation  not  pub- 
licly available,  and  summarizing  past  research 
and  development  activities . 

ideas  which  are  formulated  as  the  result  of  dis- 
cussion among  the  immediate  project  group. 

ideas  which  are  the  result  of  test  or  experiment 
or  matheimtical  simulation  with  no  immediate  in- 
put of  information  from  any  other  source. 

information  obtained  from  another  division  of 
your  company 
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FIGURE  k.      TYPICAL  SOLUTION  DEVELOPMENT  RECORD  PLOTS 
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The  resixlting  rank  orders  of  Information  channels  for  each  criterion  pro- 
vide subjective  estimates  of  "channel  cost"  and  "channel  payoff,"  or  value. 
These  channel  rankings  can  be  tested  for  correlation  with  rank  orders  based 
on  the  frequency-of-use  determined  from  Solution  Development  Record  data. 
This  technique  makes  possible  the  identification  of  the  relative  importance  of 
various  criteria  in  information  channel  selection.   The  post-project  interview 
was  also  used  to  determine  the  information  sources  which  had  brought  to  mind 
each  of  the  solution  alternatives  considered  by  each  engineer. 

RESULTS 

Seven  hypothesis  are  tested  in  the  study.  All  are  concerned  with  predict- 
ing the  criteria  which  determine  both  the  frequency  with  which  an  information 
channel  is  used  and  the  order  in  which  it  is  consulted  by  an  engineer  requiring 
information: 

(1)  those  information  channels  which  are  considered  more  readily 
accessible  will  be  used  more  frequently  than  less  accessible 
channels, 

(2)  those  information  channels  which  are  considered  easier  to  use 
will  he  used  more  frequently  than  less  easy  to  use  channels, 

(3)  those  information  channels  which  are  believed  to  provide  in- 
formation of  higher  quality  will  be  used  more  frequently 
than  those  providing  lower  quality,  less  reliable  information, 

(4)  those  information  channels  which  are  considered  more  readily 
accessible  will  be  used  first  in  the  couirse  of  an  active  in- 
formation search, 

(5)  those  information  channels  which  are  considered  easier  to  use 
will  be  used  first  in  the  course  of  an  active  inforimtion  search, 

(6)  those  information  channels  which  are  believed  to  provide  informa- 
tion of  higher  quality  or  reliability  will  be  used  first  in  the 
course  of  an  active  information  search. 
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(Y)  a  greater  proportion  of  ideas  (measured  by  the  ratio  of 
messages  accepted  to  those  received)  will  be  accepted 
from  those  information  channels  which  are  believed  to 
provide  information  of  higher  quality  or  reliability. 


Frequency  of  Use 

Testing  the  first  hypothesis,  we  find  (Table  II  a  strong  relation  (Kendall 
Tau  =  0.6t,  p<  O.Ol)  between  channel  accessibility  and  frequency  of  use.   This 

Table  II 

Comparison  of  Frequency  of  Use  With  Median  Ranlc  Orderings  Assigned  to  Information 

Channels  on  the  Basis  of  Three  Criteria 
(Nineteen  R&D  Engineers) 


Criterion 

Frequency 

Ease 

of 

Accessi- 

of 

Technical 

Use 

bility 

Use 

Quality 

Literature 

3 

3 

1 

1 

Vendors 

h 

5 

8 

3 

Customer 

T 

8 

9 

6 

External  Sources 

8 

9 

6 

7 

Technical  Staff 

2 

1 

3 

k 

Company  Research 

6 

6 

5 

9 

Group 

1 

2 

k 

2 

Experimentation 

5 

k 

2 

5 

Other  Division 

9 

1 

7 

8 

first  order  test  provides  substantial  support  for  the  first  hypothesis.   Turn- 
ing to  the  second  criterion,  ease  of  use,  a  somewhat  weaker  relationship  ( L   = 
O.kk,    p<  0.06)  is  found  between  the  channel  ranlcings .   The  application  of  par- 
tial correlation  analysis  (Table  III)  to  the  data  clearly  reveals  the  magnitude 
and  direction  of  the  relationship.  Accessibility  is  definitely  the  dominant 
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Table  III 
R'^lation  of  Three  Selection  Criteria  to  Frequency  of  Information  Channel  Use 


Correlation  between 
frequency  of  use 
and: 

Kendall 
Tau 

Kendall 
Tau 

(partialled) 

variable 
partialled 
out 

perceived 
accessibility 

0.67** 

0.58 
0.64 

ease  of  use 
tech.  quality 

perceived  ease 
of  use 

O.kk* 

-0.18 
0.36 

accessibility 
tech.  quality 

perceived  technical 
niiality 

0.28 

0.03 
0.08 

accessibility 
ease  of  use 

** 


p<  0.05 

p<  0.01 


cost  criterion  determining  the  relative  frequency  vith  which  information  chan- 
nels are  used.  When  accessibility  is  held  constant,  ease  of  use  actually  shows 
a  slightly  negative  relation  with  frequency  of  use.  Similarly,  in  the  case  of 
perceived  technical  quality,  there  is  a  weak  positive  relation  with  frequency 
of  use,  but  when  accessibility  is  controlled,  the  relation  approaches  zero. 
Apparently,  in  the  minds  of  the  subjects,  there  is  some  relation  between  their 
perceptions  of  technical  quality  and  channel  accessibility,  but  it  is  the  ac- 
cessibility component  which  almost  exclusively  determines  frequency  of  use. 
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First  Sources 

Each  subject  was  asked  once  a  week  to  report  two  instances  during  the  pre- 
ceding week  in  which  he  actively  sought  information.   In  each  instance,  subjects 
reported  whether  or  not  the  search  was  "successful,"  and  the  order  in  which  they 
contacted  channels.  A  total  of  15^  searches  were  reported. 

Table  IV  presents  the  correlations  between  frequency  of  selection  as  a  first 
source  and  the  three  criterion  variables.   Here  again  accessibility  appears  as 


Table  IV 

Relation  of  Three  Selection  Criteria  to  Frequency  of  Channel  Selection  as  a 

First  Source 


Correlation  between 

Kendall 

variable 

frequency  of  selection 

Kendall 

Tau 

partialled 

as  a  first  source  and: 

Tau 

(partialled) 

out 

perceived 
accessibility 


perceived 
ease  of  use 


perceived 
technical  quality 


0.67 


O.kk 


0.39 


,** 


0.57 

ease  of  use 

0.61 

tech.  qual. 

-0.16 

accessibility 

0.31 

tech.  qual. 

0.19 

accessibility 

0.21 

ease  of  use 

* 


•X-* 


p  <  0.05 
p  <  0.05 


the  dominant  criterion  upon  which  selection  is  based.   Engineers  turn  first  to 
that  channel  which  is  most  accessible;  perceived  technical  quality  influences 
this  decision  only  to  a  minor  extent. 
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The  Effect  of  Experience 

One  would  expect  that  the  degree  of  experience  which  an  engineer  has  with 
a  given  information  channel  would  influence  his  perception  of  both  costs  and 
value  associated  with  that  channel.   He  might  never  use  the  library,  for  ex- 
ample, because  of  a  misperception  that  it  contains  nothing  of  value,  or  that 
it  is  really  too  difficult  to  find  what  you  are  looking  for.   Given  some  mod- 
erate amount  of  experience  with  library  use,  however,  he  may  come  to  adjust 
these  perceptions  so  that  they  are  more  in  accord  v;ith  reality.   Similarly 
with  interpersonal  channels,  increased  experience  should  adjust  perceived  costs. 
The  adjustment  can,  of  course,  mean  either  an  increase  or  decrease  in  perceived 
cost,  and  may  be  entirely  random,  increasing  for  some  individuals  or  channels 
and  decreasing  for  others.   Should  the  latter  situation  hold,  correlation  analy- 
sis will  fail  to  detect  any  systematic  trend,  and  a  zero  correlation  will  be 
found  between  experience  and  perceived  cost.   If,  however,  experience  brings 
about  a  systematic  shift  (most  subjects  shifting  in  the  same  direction  with  re- 
spect to  most  channels),  correlation  analysis  can  detect  this  phenomenon  and 
will  show  a  positive  or  negative  correlation  between  experience  and  cost. 

Table  V  shows  the  nine  channels  arranged  according  to  the  amount  of  ex- 
perience the  engineers  report  having  had  with  each  of  them.   Table  VI  demon- 
strates quite  clearly  that  a  strong  positive  relationship  holds  between  the 
degree  of  experience  an  engineer  has  had  with  a  given  channel  and  both  per- 
ceived accessibility  and  ease  of  use. 

Of  co-urse,  the  engineer  may  simply  refer  more  frequently  to  those  chan- 
nels which  he  sees  as  more  accessible  or  easier  to  use.  In  other  words,  the 
direction  of  causality  may  be  from  cost  to  experience.   Lower  cost  channels 
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Table  V 


Median  Rank  Ordering  of  Information  Channels 
on  the  Basis  of  Degree  of  Experience 
(19  R&D  Engineers) 


Information  Channels 


Ranking  Assigned 


LITERA1URE 

GROUP 

EXPERIMENTATION 

TECHNICAL  STAFF 

VENDORS 

COMPANY  RESEARCH 

CUSTOMER 

OTHER  DIVISION 

EXTERNAL  SOURCES 


1 
2 

3 

h 

5 
6 

7 

8 

9 


Table  VI 

Correlation  and  Partial  Correlation  Coefficients  for  Relation  Between 
Degree  of  Experience  and  Perceived  Costs  of  Using  Information  Channels 


correlation 

Kendall 

between  degree  of 

Kendall 

Tau 

variable 

experience  and: 

Tau 

(partialled) 

partialled  out 

accessibility- 

0.72** 

0.37 

ease  of  use 

0.53 

frequency  of  use 

ease  of  use 

0.72** 

0.37 

accessibility 

0.60 

frequency  of  use 

frequency  of  use 

0.61** 

0.25 

accessibility 

0.51 

ease  of  use 

technical  quality 

0.56* 

o.ii3 

accessibility 

0.32 

ease  of  use 

0.39 

frequency  of  use 

** 


p  <  0.05 

p  <  0.01 
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are  used  more  and  he  thereby  acciumilates  greater  experience  with  them.   To  test 
this  possibility  and  determine  causal  direction,  the  frequency  with  which  the 
engineers  used  the  nine  channels  is  controlled  and  the  relation  between  experi- 
ence and  perceived  cost  again  tested  (Table  Vl).   This  reduces  both  of  the 
original  relations  somewhat,  but  reasonably  strong  correlations  remain,  thus 
indicating  that  the  degree  of  experience  that  an  engineer  acquires  with  an  in- 
formation channel  does  tend  to  lov/er  his  perception  of  the  cost  of  using  that 
channel . 

Perception  of  Technical  Quality 

Allen  (1966b)  measured  the  rate  at  which  information  channels  were  respon- 
sible for  generation  of  alternative  ideas  and  the  rate  at  which  ideas  emanating 
from  each  information  channel  were  accepted  as  the  solutions  to  engineering 
problems.   The  ratio  of  these  two  parameters  (channel  acceptance  ratio)  was 
then  used  as  a  measure  of  the  propensity  for  engineers  to  apply  a  filtering 
process  to  channel  output.  A  relatively  low  acceptance  ratio,  in  this  sense, 
implies  that  a  more  severe  filter  has  been  applied  to  a  channel;  a  high  accep- 
tance ratio  implies  the  relative  absence  of  filtering.   Information  from  ven- 
dors is  found,  for  example,  to  be  subjected  to  more  severe  filtering  than  in- 
formation obtained  from  an  engineer's  technical  staff. 

If,  in  fact,  such  a  filtering  process  operates,  it  should  generally  be 
based  upon  the  engineer's  assessment  of  the  quality  and  reliability  of  the 
information  provided  by  a  channel,  and  there  is  little  likelihood  that  it 
would  be  based  upon  channel  cost.   The  engineers  in  the  sample  were  asked  to 
provide  just  this  assessment  for  each  channel  in  the  form  of  a  rank  ordering- 
In  addition,  the  channels  responsible  for  generating  all  considered  alternatives 
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(as  reported  on  the  Solution  Development  Records)  were  ascertained  during  the 

final  interviews.   Thus,  it  is  possible  to  derive  an  acceptance  ratio  for  each 

2 
of  the  channels . 

Since  many  of  the  problems  examined  were  not  completed  successfully  during 

the  course  of  this  brief  study,  and  because  the  sample  of  problems  was  small  to 

begin  V7ith,  the  number  of  messages  received  and  accepted  from  each  channel  is 

believed  to  be  too  small  for  the  generation  of  meaningful  acceptance  ratios. 

For  this  reason,  Allen's  ( 1966b)  data  are  included  in  Table  VII  and  are 

Table  VII 
Sources  of  Ideas  and  Acceptance  Ratios 


Number 

Numbi 

er 

Overall 

of  messages 

of  messages 

acceptance 

Information 

rece: 

Lved 

accepted 

ratios 

channels 

Allen 

Allen 

present 

(1966b) 

present 

( 1966b ) 

(messages  accepted/ 

data 

data 

data 

data 

messages  received) 

LITERATURE 

7 

71 

5 

27 

O.Ul 

VENDOR 

k 

72 

2 

37 

0.37 

CUSTOMER 

1 

101 

1 

33 

0.2l|- 

EXTERNAL  SOURCES 

5 

132 

1 

kl 

0.49 

TECHNICAL  STAIT 

10 

h5 

6 

2h 

0.55 

COiyiPANY  RESEARCH 

25 

38 

11 

20 

0.49 

cmoup 

15 

- 

k 

- 

0.27 

EXPERIMENTATION 

1 

- 

0 

- 

** 

OTHER  DIVISION 

1 

- 

0 

- 

** 

Unknown 

20 

75 

3 

6 

- 

^These  channels  were  not  considered  in  the  Allen  study. 
**Too  few  messages  received  to  develop  a  meaningful  acceptance  ratio. 


Two  of  the  channels,  "experimentation"  and  "other  division,"  generated  only 
one  message  apiece.   No  acceptance  ratio  is  calculated  for  these  channels 
for  reason  of  insufficient  data. 
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aggregated  with  the  present  data  in  computing  acceptance  ratios. 

In  Table  VIII,  the  acceptance  ratios  are  correlated  with  each  of  the  three 
criterion  variables  that  were  measiired  in  the  study.   Perceived  technical  quality 


Table  VIII 

Relation  of  Three  Selection  Criteria  to 
Message  Acceptance  Ratio  of  Information  Channels 


correlation  between 

Kendall 

variable 

message  acceptance 

Kendall 

Tau 

partialled 

ratio  and: 

Tau 

(partialled) 

out 

perceived 

accessibility 

0.05 

-0.19 

ease  of  use 
tech.  quality 

perceived  ease 

of  use 

O.lU 

0.23 

accessibility 

perceived  technical 
quality 


O.I13 


-0.11 


0.k2 


tech.  quality 


accessibility 
ease  of  use 


* 


P<  0.05 


is  the  only  channel  characteristic  which  correlates  significantly  with  accep- 
tance ratio.   This  is  quite  the  reverse  of  what  has  been  observed  up  until  this 
point.   Neither  accessibility  nor  ease  of  use  appear  to  influence  acceptance 
rate  to  any  extent.   The  engineer's  perception  of  the  technical  quality  of  in- 
formation channels,  however,  does  influence  the  rate  at  which  he  accepts  ideas 
from  those  channels.   In  other  words,  the  filtering  process  is  based  at  least 
in  part  on  the  perception  of  technical  quality,  and  not  at  all  on  accessibility 
or  ease  of  use. 
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DISCUSSION 

Any  assumption  that  engineers  act  in  accord  with  a  simple  instrumental 
learning  model  in  i/hich  they  turn  most  frequently  to  those  information  chan- 
nels which  reward  them  most  often  should  now  clearly  be  laid  to  rest .   Engi- 
neers, in  selecting  among  information  channels,  act  in  a  manner  which  is  in- 
tended not  to  maximize  gain,  but  rather  to  minimize  loss.   The  loss  to  be  min- 
imized is  the  cost  in  terms  of  effort,  either  physical  or  psychological,  which 
mast  be  expended  in  order  to  gain  access  to  an  information  channel. 

Their  behavior  is,  in  this  way,  reminiscent  of  Zipf 's  "law  of  least  effort." 
According  to  Zipf 's  Law,  individuals,  v/hen  choosing  among  several  paths  to  a 
goal,  will  base  their  decision  upon  the  single  criterion  of  least  average  rate 
of  probable  work.   In  other  words,  to  minimize  his  average  rate  of  work  expen- 
diture over  time,  "...  an  individual  estimates  the  probable  eventualities,  and 
then  select(s)  a  path  of  least  average  rate  of  work  through  these." 

In  the  selection  of  information  channels,  our  engineers  certainly  appear 
governed  by  a  principle  closely  related  to  Zipf 's  Law.   They  attemjjt  to  mini- 
mize effort  in  terms  of  the  work  required  to  gain  access  to  an  information  chan- 
nel.  However,  they  either  ignore  probable  future  work  (searching  through  other 
channels,  upon  failure  to  find  the  needed  information  through  the  first  channel), 
or  they  are  unable  to  estimate  it.   If,  in  fact,  engineers  were  to  consider  fu- 
ture effort  in  making  their  decision,  we  would  expect  to  find  a  negative  corre- 
lation between  the  mean  number  of  channels  which  must  be  used  to  gain  the  de- 
sired information  after  selecting  one  channel  as  the  first  source.   In  other 
words,  for  each  time  that  a  given  channel  is  chosen  as  a  first  soiorce,  the  mun- 
ber  (including  zero)  of  channels  which  had  to  be  used  before  the  information  was 
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in  hand  can  be  co\inted.   The  mean  number  of  additional  channels  used  can  be  com- 
puted for  each  channel.   This  mean  score  serves  as  an  index  of  the  long  term  ef- 
fort (over  and  above  that  effort  connected  with  gaining  access)  associated  with 
each  information  channel.   That  correlating  this  index  with  the  frequency  of 
use  of  each  channel  produces  a  near- zero  correlation  indicates  that  engineers 
do  not  take  this  long  term  effort  into  account  in  selecting  channels.   So  we 
are  left  with  engineers  behaving  according  to  a  simplified  version  of  Zipf 's 
Law,  in  which  they  take  only  their  immediately  predictable  effort  into  account 
and  minimize  that  parameter  in  making  their  decision. 

The  implications  of  this  finding  are  very  important .   Improving  the  quality 
or  performance  of  a  particular  information  service  will  not,  in  and  of  itself, 
lead  to  increased  use  of  the  service.   More  investment  in  library  holdings,  for 
example,  will  be  wasted  unless  at  the  same  time  we  make  this  material  more  ac- 
cessible to  the  user.  Engineers  won't  simply  be  attracted  to  the  library  by  im- 
provements in  the  quality  or  quantity  of  the  material  contained  there .   The  li- 
brary must,  in  a  sense,  come  to  them. 

Those  concerned  with  R&D  management  whether  they  are  laboratory  directors, 
librarians  or  administrators  of  professional  engineering  societies  have  both  di- 
mensions of  this  problem,  to  varying  degrees,  within  their  control.   To  some  ex- 
tent they  can  control  the  quality  of  the  information  which  is  available  through 
certain  channels.   The  laboratory  director,  for  example,  can  through  hiring  make 
available  a  more  competent  technical  staff  to  imp-rove  the  quality  of  internal 
consulting.   The  librarian  can  improve  the  extent  and  quality  of  the  material 
contained  in  the  library.   The  professional  societies  can  through  careful  edit- 
ing and  review  improve  the  quality  of  their  present  publications  or  make  new 
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putlications  or  services  available  to  the  membership.  Improvements  in  any  or 
all  of  these  directions  may  well  be  desirable.  But  it  must  be  remembered  that 
such  improvement,  by  itself,  will  not  guarantee  any  improvement  in  the  perfor- 
mance of  the  organization  or  of  the  engineering  community.   Before  the  improved 
information  service  can  lead  to  increased  performance,  it  must  be  used.'  And 
the  only  way  to  increased  use  is  through  increased  accessibility.  Fortunately, 
however,  this  parameter  can  usually  be  quite  readily  controlled  by  managment. 
The  laboratory  director  must  not  just  hire  more  competent  technical  staff,  he 
must  encourage  their  use  as  consultants  by  rewarding  them  for  this  function, 
and  by  encouraging  his  engineers  to  go  to  them  for  information.   He  must  make 
it  known  that  no  one  will  downgrade  a  man  for  seeking  help  and  take  steps  to  re- 
duce the  psychological  risk  and  cost  in  internal  consulting.   The  librarian 
miast  make  his  services  more  readily  available.  This  may  involve  some  rather 
expensive  additions  to  personnel  (library  assistants  specializing  in  particular 
technical  areas,  special  messenger  services,  mobile  libraries,  etc.).   o.t  un- 
less this  additional  investment  is  made,  the  money  spent  on  library  holdings 
and  facilities  will  be  wasted.   The  engineering  societies,  too,  can  make  their 
services  more  accessible.  Many  such  improvements,  as  for  example  selective  dis- 
semination, demand  deposit  and  the  publication  of  critical  annual  reviews  with 
extensive  reference  lists,  have  been  discussed  in  recent  years,  and  many  of 
these  hold  great  promise.   But  there  is  a  more  iniportant  step  which  the  soci- 
eties might  take  to  make  their  material  more  accessible.   The  principal  reason 
for  the  reluctance  of  engineers  to  use  their  professional  literature  is  that, 
for  the  most  part,  they  cannot  understand  it.   Most  of  the  professional  engi- 
neering literature  is  too  mathematically  sophisticated  for  the  average  engineer 
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to  comprehend.   It  is  therefore  inaccessible  to  him.   Now  if  one  vishes  to  bring 
engineers  into  greater  contact  with  their  literature,  there  are  two  obvious  ap- 
proaches .   The  first  is  to  operate  on  the  engineer  and  enhance  his  mathematical 
sophistication;  equip  him  so  that  he  can  understand  the  literature  as  it  now  ex- 
ists.  The  second  and  perhaps  more  tractable  approach  is  to  bring  the  literature 
to  the  engineer.   The  professional  societies  should  publish  a  literature  form, 
whose  technical  content  is  reasonably  high,  but  which  is  understandable  by  the  au- 
dience to  \.'hom  it  is  directed.   This  is  not  an  easy  task.   And  it  does  not  neces- 
sarily imply  that  the  societies  forego  all  of  their  present  program  of  publications. 
What  it  does  mean  is  that  these  publications  are  at  least  supplemented  by  a  series 
of  more  readable  works.   That  this  can  be  done  is  amply  demonstrated  by  the  success 
of  a  large  number  of  profit-making,  controlled  circulation  publications,  which  engi- 
neers do  read  (Allen,  1966c).   The  engineering  societies  should  give  up  their  style 
of  emulating  the  scientific  societies.   Their  goals  are  different.   There  is  noth- 
ing wrong  with  publishing  non-original  contributions  in  engineering.   The  goal  of 
engineering  publication  is  to  inform,  not  to  stake  out  claims.   Only  when  the  engi- 
neering societies  come  to  realize  this  will  they  serve  their  audience  properly. 

Furthermore,  since  engineers  perceive  channels  to  be  more  accessible  as  they 
gain  greater  experience  in  using  them,  any  steps  to  increase  use  through  improving 
accessibility  will  be  self-reinforcing.   As  laboratory  managers  make  their  inter- 
nal consultants  more  accessible,  they  will  come  to  be  used  more  and  the  engineers' 
perception  of  their  accessibility  will  be  further  enhanced.  As  engineers  gain 
more  experience  with  the  more  accessible  professional  literature,  their  percep- 
tion of  increased  accessibility  may  generalize  to  the  more  sophisticated  litera- 
ture and  encourage  them  to  work  toward  improving  their  ability  to  comprehend  this 
literature . 
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Engineers,  it  is  true,  do  compensate,  by  varying  the  degree  of  skepticism 
with  which  they  filter  the  ideas  received,  for  their  lack  of  attention  to  qual- 
ity vhen  selecting  an  information  channel.   This  is  an  interesting  phenoinenon 
in  which  technical  quality  is  recognized,  but  its  consideration  is  delayed  un- 
til after  the  channel  has  been  selected.  Accepting  or  rejecting  messages  (com- 
ponents of  alternatives,  see  Figure  l),  is  a  process  which  takes  place  over  a 
considerable  period  of  time.   The  focus  during  this  period  Is  technical  quality 
(including,  of  course,  cost  and  availability).   The  alternatives  under  consid- 
eration are  quite  rigorously  compared  in  terms  of  this  dimension.   It  is  no  won- 
der then  that  the  perceived  reliability  of  the  source  is  taken  into  account, 
and  that  ideas  are  accepted  or  rejected  partly  on  that  basis. 

From  a  simple  engineering  viewpoint,  this  seems  to  be  an  appallingly  inef- 
ficient way  of  doing  things:   using  the  wrong  criterion  early,  and  later  correct- 
ing for  it.   This  is  one  more  reason  why  we  must  take  steps  to  aid  +he  engineer 
in  overcoming  the  channel  selection  problem.  Many  of  the  suggestions  kvj.:-  ear- 
lier in  this  section  should  more  than  pay  for  themselves  in  terms  of  engineering 
effort  conserved. 

CONCLUSIONS 
Empirical  support  is  found  for  the  model  of  the  information  channel  selec- 
tion process  first  proposed  by  Allen  (1966c).   In  this  process,  channel  selec- 
tion is  based  almost  solely  on  channel  accessibility,  the  most  accessible  chan- 
nels being  used  first.   The  difficulties  inherent  in  this  process  are  then 
countered  by  a  filtering  process  which  applies  a  variable  degree  of  skepticism 
to  ideas  supplied  by  different  channels.   The  degree  of  skepticism  is  a  fonction 
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of  the  engineer's  perception  of  the  technical  quality  of  the  information  nor- 
mally provided  by  the  channel. 

The  following  specific  conclusions  are  derived  from  the  study: 

1.  Accessibility  is  the  single  most  important  determinant  of 
the  overall  extent  to  which  an  information  channel  is  used. 

2.  Both  accessibility  and  perceived  technica]  quality  influ- 
ence the  choice  of  first  source. 

3-   Perception  of  accessibility  is  influenced  by  experience. 
The  more  experience  an  engineer  has  with  a  channel,  the 
more  accessible  he  perceives  it  to  be. 

k.      The  rate  at  which  ideas  are  accepted  or  rejected  is  re- 
lated to  the  perceived  quality  of  the  information  pro- 
vided by  a  channel.   Engineers  thus  use  technical  qual- 
ity as  the  criterion  in  a  filtering  process  which  compen- 
sates, in  part,  for  the  neglect  of  technical  quality  con- 
siderations when  selecting  an  information  channel. 
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